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@ A processor presents a sequence of images of a 
hierarchical structure that is perceived as three-di- 
mensional. The hierarchical structure includes conic 
substructures (12. 14, 16, 18, 20) that can have 
vertical or horizontal axes. Each cone (12. 14, 16, 18, 
20) has a parent node at its vertex and children 
nodes along Its base, each with a link to the parent 
node. Each child can in turn be at the vertex of 
another cone. The cones (12. 14, 16, 18, 20) can be 
rotated in steps that produce the perception of ob- 
ject constancy for each node. For example, if the 
user requests that an indicated node be moved to a 
primary viewing position, each of the cones along 
the path from the indicated node to the root node is 
rotated in the direction that most directly moves the 
indicated node to the primary viewing position. Each 
node can include a selectable unit for indicating it, 
and a node can also include a grow tab that can be 
selected to request presentation of its children nodes 



and links to them. The user can request that the 
children nodes of a node be replaced by a grow tab. 
To reduce the computation necessary for each step 
of rotation, the position relative to a cone's axis for 
each of 80 points on the base of a cone (12, 14, 16. 
18, 20) is computed for a level of the hierarchy and 
is then stored in an array for subsequent use in 
positioning nodes on that level. The base point (52) 
of each node on a rotating cone can then be 
changed in a linked node data structure, and its new 
position can then be obtained by simple arithmetic 
operations using the axis coordinates and the appro- 
priate data from the anray. The base of each anray 
can be a polygon whose vertices are nodes, and the 
base shape can be presented as a shadow to pro- 
vide additional information and strengthen the per- 
ception of three dimensions, or, the profiles of the 
cones can be presented as a shadow. 
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The present invention relates to techniques for 
display presentation of a structure that includes 
nodes and links in three dimensions. More specifi- 
cally, the invention relates to a presentation in 
which the geometry of the node-Unicstructure can 
change. 

FaiTchild, K.M., Poitrock, S.E., and Rur 
-^G.W.. " SemNet Three-Dimensional Graphic Repre -N 
sentatio ns of Large Knowledge Base s/ in Quindon. 
"TTTEilT ^^ognitive Science and its Application for 
Human Computer Interaction , Lawrence Erlbaum. 
Hillsdale, New Jersey, 1988. p p^ 201 -233, describe 
SemNet, a three-dimensional graphical interfa 
SemNet presents views that allow users to ex^ne 
detail while maintaining a globaUJ«0resenta- 
tinfTaf-^fe fl^est of the knQM (le€h3g'''base. SemNet 
also provides semantic navigation techniques such 
as relative movement, absolute movement, and 
teleportation. As shown and described in relation to 
Rg. 1 - 1 . SemNet represents a knowledge base as 
a directed graph in a three-dimensional space, with 
elements of knowledge represented as labeled rec- 
tangles connected by lines or arcs. As noted on 
page 206. the nodes of the network could repre- 
sent the antecedents and consequents of rules and 
the arcs could represent implication. Section 3.2, 
on pages 209-213. describes techniques, including 
multidimensional scaling and heuristics, that move 
related knowledge elements close togetiier and un- 
related knowledge elements far apart, and section 
3.3, on pages 213-214. describes how these tech- 
niques can be used with personalized positioning. 
Section 5.2.4. on pages 227'22B, describes hyper- 
space movement, in which the nodes connected to 
a selected knowledge element are temporarily 
moved to positions around it, and then snap back 
to tiieir original positions after a new node is se- 
lected. 

Ihe present invention provides techniques for 
presenting a three-dimensional node-link structure 
with a hierarchical geometry within which tiie rela- 
tive positions of nodes and links can change with- 
out losing the perceived object constancy of tiie 
nodes or links, or of tiie structure as a whole. 
When a user selects a part of tiie structure, tfie 
selected part can be brought to a primary viewing 
position by changing the geometry of the structure 
wittiout toss of object constancy. The hierarchical 
geometry can be a hierarchy of conic substruc- 
tures, each with a parent node at its vertex and 
witti chikdren nodes along a directrix, with each 
conic substructure ligned so tiiat it can rotate about 
an axis. In response to a user selection, the se- 
lected part is moved to the primary viewing posi- 
tion by a sequence of steps in which each conic 
substructure rotates as appropriate. 

One aspect of the invention is based on the 
recognition of a problem in presenting three-dimen- 



sional node-link structures, especially large struc- 
tures with many nodes and links. A node-link struc- 
ture often represents a data structure, with each 
node representing an item of data within the data 
5 structure. A user viewing such a structure fre- 
quentiy wishes to change from a view of one part 
of the structure to a view of another. Some conven- 
tional techniques allow the user to change point of 
view in relation to the structure without changing 
J 10 tiie geometry of tiie structure. Otiier conventional 
techniques allow tine user to obtain a view of a 
completely different geometry that includes a dif- 
ferent collection of nodes and links. But sometimes 
the user needs a relatively small change in the 
75 geometry to facilitate tiie viewing of a particular 
part. 

This aspect is furtiier based on ttie discovery 
that this problem can be alleviated by presenting a 
node-link structure with a geometry that can 

20 change while the perceived object constancy of 1he 
nodes and links is maintained. An example of such 
a geometry is a hierarchy of conic substructures, 
each with a parent node at its vertex and with 
children nodes along its base or other directrix, 

25 with each conic substructure aligned so that it can 
rotate about an axis. If the conic substructures are 
aligned witii ttieir axes parallel, and if each level of 
tiie hierarchy has a fixed perceived link length at 
an appropriate orientation, for example, the conic 

30 substructures can all rotate independentiy of each 
other without changing tiie perceived object con- 
stancy of the nodes and links. 

These features can be implemented in a sys- 
tem tiiat includes a processor that provides Image 

35 data to an image output device. In response, the 
image output device presents a sequence of im- 
ages tiiat include node-link structures tiiat are per- 
ceptibly different but whose nodes and links are 
perceptible as continuing through the sequence. 

40 The system can also include a user input device, 
such as a mouse, with which a user can indicate a 
node on tiie directrix of one of the conic substruc- 
tures. The sequence can be provided in response, 
with conic substructures rotating to move the in- 

45 dicated node to a primary viewing position. 

These features are especially useful in provid- 
ing a display representing a large data structure, 
such as a Unix directory or an artificial intelligence 
knowledge structure, which has many more items 

50 ttian can be presented in two dimensions on a 
screen. Using the techniques of the Invention, as 
many as 600-800 items or more can be presented 
in a three-dimensional hierarchical structure that 
fits on the screen. Th e user_ can_ yiew and rn apipu:. 

55 l ate the structure Jo^fipdJofgrm^ ^ of inte rest. The 
perceived object constancy prevents confusion dur- 
ing operations manipulating the structure. 

Closely-related aspects of the invention are 
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based on the recognition of competing consider- 
ations in rotating a hierarchy of conic substructures 
to move a node to the primary viewing position. If 
the rotation is made in large steps, the motion will 
be Jumpy; with very large steps, object constancy 
will be lost But if the rotation is made in small 
steps, and if the structure is sufficiently complex to 
require substantial computation for each step, the 
rotation may be unsatisfactorily slow. 

These competing considerations can be re- 
solved to an extent by rotating the levels of the 
hierarchy independently to provide an optimal se- 
quence of steps moving a selected node to the 
primary viewing position. If appropriate, a conic 
substructure at an upper level can rotate in a 
direction opposite ti^at of a conic substructure at a 
lower level ttiat has its vertex on the base or other 
directrix of the upper conic substructure. As a 
result the steps at each level can be performed 
concurrently, reducing the number of steps of rota- 
tion and ttie time necessary to complete the rota- 
tion. 

The time necessary for computation of each 
step of rotation nevertiieless limits tiie speed of 
rotation. Another aspect of the invention reduces 
the time necessary for computation by determining 
the position of each conic substructure at the time 
it is first displayed. If ttie determined position is a 
position relative to the axis of rotation, it need not 
be recomputed, but can be held in a data structure 
and used for each subsequent step of rotation, 
considerably reducing ttie computation required. 

Other related aspects of the invention are 
based on the recognition ttiat a user viewing a 
complex three-dimensional node-link structure finds 
it difficult to obtain information about some of its 
detailed features. The user may, for example, have 
difficulty determining how many children nodes are 
linked to a given parent node or determining which 
nodes are in the hierarchy above a given child 
node. 

Information about some detailed features of the 
structure can be provided ttirough shadows that 
reinforce the perception of the structure in three 
dimensions. The shadows can, for example, be on 
a plane that is perceived as receding toward a 
vanishing point of tiie image and that suggests an 
illumination of the structure to produce \he shadow. 

Infomnation about the numt)er of children nodes 
in a conic substructure can be provided with a 
polygonal shadow having a vertex for each child 
node. This polygonal shadow can have the same 
shape as a directrix of the conic substructure at 
which the children nodes are positioned, so ttiat ttie 
shape of the base can be determined once and 
can k>e used tx^th in presenting the structure and in 
presenting the shadow. The shadow can be posi- 
tioned as a projection of the base onto a plane ttiat 



is perceptible as parallel to tiie plane of the base. 

Information about tiie number of children nodes 
and about the connections of nodes can also be 
provided with a shadow positioned as a projection 

5 of a profile of the conic substructure onto a plane 
tiiat is perceptible as parallel to the substructure's 
axis. The profile shape can be defined by two links 
positioned at the extremes of the substructure in 
the profile, and the positions of those links can be 

10 determined once and used t)oth in presenting the 
structure and in presenting the shadow. If each 
child node includes a planar selectable unit and ttie 
plane of ttie shadow is perpendicular to the planes 
of ttie selectable units, then each child node will 

75 appear as a tine shadow extending from the profile 
shadow. 

In addition, the user can obtain information 
about the patti of links and nodes connecting a 
specific node to the uppermost node. When the 
20 user indicates a node's selectable unit the path is 
presented differentiy so ttiat tiie user can more 
easily distinguish the path. For example, the cotors 
of the links and nodes In the path could be modi- 
fied or inverted or the path could be highlighted in 
25 another way. 

Another aspect of ttie invention allows ttie user 
to reduce ttie part of a hierarchical structure that is 
presented for display, so that features of the re- 
maining part are more easily discerned. The user 
30 can indicate a node and request that the substruc- 
ture depending from it not be displayed; in re- 
sponse, ttie substructure can be removed from tiie 
image and the node can be changed to include a 
selectable unit for recreating the substructure. 
35 Similarly, the user can indicate a node and request 
that any substructure that does not depend directiy 
from ttie node or from one of its ancestors or 
descendants be replaced by such a selectable unit 
The present invention will bwo be described by 
40 way of example with reference to the accompany- 
ing drawings in which: 

Rg. 1 is a display view showing a hierarchical 
structure witti conic substructures tiiat can rotate 
about vertical axes, according to tiie invention; 
45 Fig. 2 is a display view showing a hierarchical 
structure with conic substructures that can rotate 
about horizontal axes according to the invention; 
Rg. 3 is a schematic partial plan view of the 
hierarchical structures of Rgs. 1 and 2; 
50 Rgs. 4, 5, and 6 are schematic partial plan 
views showing successive steps in the rotation 
of the conic substructures to bring a selected 
node to a primary viewing position; 
Rg. 7 is a flow chart showing general steps In 
55 presenting a structure like those in Rgs. 1 and 
2; 

Rg. 8 is a schematic diagram of a data item for 
a node in a linked node data structure tiiat can 
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be used in providing a structure like those in 
Figs. 1 and 2; 

Rg. 9 is a flow chart showing steps in assigning 
initial base points in Rg. 7; 
Rg. 10 is a flow chart showing steps in assign- 
ing positions in Rg. 7; 

Rg. 1 1 is a flow chart showing steps in display* 
ing a structure in Rg. 7; 

Rg. 12 is a schematic diagram of shadows 
presented with a structure with conical substruc- 
tures that can rotate about vertical axes; 
Rg. 13 is a schematic diagram of shadows 
presented with a structure with conical substruc- 
tures that can rotate about horizontal axes; 
Rg. 14 Is a flow chart showing steps within an 
animation step that rotates ail or part of a hierar- 
chical structure; 

Rg, 15 is a flow chart showing steps in respond- 
ing to a request for rotation in Rg. 7; 
Rg. 16 is a flow chart showing steps in within an 
animation step that moves a node toward tiie 
primary viewing position; 
Rg. 17 is a flow chart showing steps In growing 
a structure by presenting an additional substruc- 
ture; 

Rg. 18 is a flow chart showing steps in shrinking 
a structure by ending presentation of a substruc- 
ture; 

Rg. 19 is a schematic block diagram showing 
components of a system implementing the in- 
vention; 

A. Conceptual Framework 

The following conceptual framework is helpful 
In understanding tiie broad scope of the invention, 
and the tenms defined below have the meanings 
indicated throughout tills application, including tfie 
claims. This conceptual framework Is a modification 
and extension of tinose set forth in JP-A- 
64.003.730. US-A-4.982.344 and JP-A-1 97.946. 

A "data processing system* is a system that 
processes data. A "data processor" or "processor" 
is any component or system that can process data, 
and may include one or more central processing 
units or other processing components. A "user 
input device" is a device such as a keyboard or a 
mouse that can provide signals based on actions of 
a user. An "image output device" is a device that 
can provide an image as output A "display" is an 
image output device that provides information in 
visible form, such as on tiie screen of a catiiode 
ray tube. The visible pattern presented by a dis- 
play is an "image." 

A wide variety of display techniques for data 
processing systems is available, including, for ex- 
ample, various graphical user interfaces, but. de- 
spite tiieir diversity, ttiese techniques tend to have 



certain common characteristics. One fundamental 
common characteristic is that a display produces 
human perceptions. In tiiis application, the term 
"display feature" refers to any human perception 

5 produced by a display. 

A "structure" is a display feature that includes 
other display features within it. all of which appear 
to be connected into a unity. , 

A "node-link structure" is a structure that in- 

70 eludes display features that can be distinguished 
into "nodes" that are localized and "links" that 
extend between and connect the nodes. In the 
limit, a node can be localized to a just-perceptible 
point, and a link can be a just-perceptible line 

T5 extending between nodes, but all that Is necessary 
for a node-link structure is that the nodes are 
sufficiently localized and tiie links are sufficiently 
extended that nodes and links are distinguishable. 
A "three-dimensional stnjcture" Is a structure 

20 that is perceived as extending in ttiree orthogonal 
dimensions. Typically, a display will have a two- 
dimensional display surface and the perception of 
tiie third dimension will be produced with visual 
cues such as obscuring of distant objects by near 

25 objects, size changes in objects tiiat change dis- 
tance as Irt perspective drawing, and different 
shading of objects at different distances. 

A "hierarchical structure" is a structure that is 
perceptible as having a number of levels. A hierar- 

30 chical node-link structure, for example, could have 
a number of levels of nodes, with links connecting 
each node on a lower level to one of tiie nodes on 
an upper level. Each node could represent a node 
in a tree data stmcture or in another directed graph 

35 data structure tiiat is organized into levels. 

A "conic substructure" Is a part of a hierarchi- 
cal stnjcture tiiat is perceptible as having a conic 
shape witti a circular or polygonal directrix such as 
its base. If tiie hierarchical structure has nodes and 

40 links, for example, a parent node could be at the 
vertex of a conic substructure and its children 
nodes could be on the base or another directrix of 
the conic substructure, connected to the parent 
node by links tiiat produce tiie perception of a 

45 conic shape. 

A second display feature is perceptible as a 
"continuation" of a first display feature when the 
presentation of tiie second display feature follows 
the presentation of ttie first display feature in such 

50 a way ttiat tiie user perceives tiie first display 
feature as being continued when the second dis- 
play feature is presented. This can occur when tiie 
successive display of two display features Is so 
close In time and space that ttiey appear to be ttie 

55 same display feature. An example of this is tiie 
phenomenon called "object constancy." 

If a second conic substructure Is perceptible as 
a continuation of a first conic substructure, it may 
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also be perceptible as a "rotated continuation" if 
presentation of the second conic substructure pro- 
duces the perception that the first conic substruc- 
ture has rotated about an axis. 

Two node-link structures are "perceptibly dif- 
ferent" or "perceptible as different" when they can 
be perceived as including different nodes or [inl<s 
or as including nodes and linio that are positioned 
differently in relation to each other. For example, 
even where first and second node-link structures 
are presented in such a way that the nodes and 
links of the second structure all appear to be con- 
tinuations of the nodes and links of the first struc- 
ture, the two structures may still be perceptibly 
different if the nodes and links within the second 
structure are positioned differently in relation to 
each other from the nodes and links within the first 
structure. But first and second node-link structures 
presented in such a way that the nodes and links 
all appear to be continuations, would not be per- 
ceptibly different if merely viewed from a different 
point of view, at a different scale, or with a different 
texture, coloration, background, illumination, or oth- 
er non-structural difference. Therefore, an affine 
transformation of a first node-link structure, by it- 
self, does not produce a second node-link structure 
that is perceptible as different from the first node- 
link structure. 

A 'selectable unit" is a display feature that is 
perceived as a t>ounded display area that can be 
selected. The term "select," when used in relation 
to a selectable unit, means a user input operation 
that includes a signal that uniquely indicates the 
selectable unit The user can. for example, use a 
pointing device such as a mouse to select a selec- 
table unit by indicating its position on a display and 
clicking a button on the pointing device. In general, 
a selectable unit may take any appearance, and is 
not limited to a visually distinguishable feature or 
set of features that appears to be a coherent unity. 

B. General Features 

Figs. 1-6 illustrate general features of the in- 
vention. Rgs. 1 and 2 show three-dimensional hier- 
archical structures with conic substructures that 
can rotate while preserving object constancy. The 
structure of Rg. 1 is vertically oriented, and the 
structure of Fig. 2 is horizontally oriented. Rgs. 3-6 
show partial plan views illustrating rotation of the 
conic substructures to move a selected node to a 
primary viewing position. 

In Rg. 1, structure 10 includes conic substruc- 
tures 12, 14. 16, 18, and 20 in hierarchical levels. 
Several cues within structure 10 allow a human to 
perceive it as three-dimensional. For example, the 
bases or directrices of the conic substructures, 
illustratively elliptical as can be seen from base 22 



of conic substructure 12, are perceptible as tilted 
circles receding from the viewing point Also, the 
links, illustratively of different lengths as can be 
seen from links 24 and 26. are perceptible as 

5 having equal length because of some links being 
closer to the viewing point than others. The nodes, 
illustratively including selectable units of different 
sizes as can be seen from nodes 28 and 30, are 
perceptible as of equal size because of some 

70 nodes being closer to tine viewing point than oth- 
ers. 

As can be understood from Rg. 1. an image of 
structure 10 could be followed by a sequence of 
images in which each of the conic substructures is 

75 replaced by a series of similar conic substructures 
that are perceptible as slightiy rotated continu- 
ations, rotating about vertical axes. For example. If 
a user indicated node 32 and requested that it be 
moved to a primary viewing position closest to the . 

20 viewer, conic substructures 20, 18. 16, and ~12 
could rotate to move node 32 to tiie requested 
position. 

Viewing structure 10 from atjove. ttie rotation to 
move node 32 to the primary viewing position 

25 could be as follows: Substnjctures 20, 18. and 16 
could rotate counterclockwise. Substructure 12 
could rotate clockwise. These rotations could be 
concurrent, and could continue until links 34, 36, 
38, and 40 are all aligned toward the primary 

30 viewing position. Nodes 42. 44, and 46 would also 
be in the primary viewing position. 

In Rg. 2. structure 60 includes conic substruc- 
tures 62. 64, 66, 68. and 70 in hierarchical levels. 
As in Rg. 1 , several cues within structure 60 allow 

35 a human to perceive it as tiiree-dimensional. in- 
cluding: the elliptical bases as can be seen from 
base 72 of conic substructure 62; the links of 
different lengths as can be seen from links 74 and 
76; and the nodes including selectable units of 

40 different sizes as can be seen from nodes 78 and 
80. 

As discussed in relation to Rg. 1, an image of 
structure 60 could be followed by a sequence of 
images in which each of tiie conic substructures is 

45 replaced by a series of similar conic substructures 
that are perceptible as slightly rotated continu- 
ations, rotating about horizontal axes. For example, 
viewing staicture 60 from the left, ttie rotation to 
move node 82 to tiie primary viewing position 

50 could be as follows: Substi^ictures 70, 68. and 66 
could rotate counterclockwise. Substructure 62 
could rotate clockwise. These rotations could be 
concurrent, and could continue until links 84, 86. 
88, and 90 are all aligned toward ttie primary 

55 viewing position. Nodes 92.94, and 96 would also 
be in the primary viewing position. 

In eitiier structure 10 or structure 60. tiie user 
could request that a node be moved to the primary 
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viewing position by selecting that node's selectable 
unit Nodes 50 and 100. in addition to selectable 
units for requesting that they be moved, also in- 
clude selectable units 52 and 102. called "grow 
tabs." The user can select the grow tab of a node 
to request presentation of its children nodes, which 
are not displayed when the grow tab is displayed, 
together with links that connect the node to Its 
children. 

Rg. 3 shows a partial plan view of structure 10 
in Rg. 1, viewed from above as if it existed in 
three-dimensions. Rg. 3 omits the links and the 
selectable units, and shows each node as a large 
dot. The base of each conic substructure is shown 
as a circle, with 80 points defined on it as dis- 
cussed in more detail below. The same features 
would appear in a view of structure 60 in Rg. 2 
from the left. I.e. with the x-axis replaced by the y- 
axis. For example, base 22 is equivalent to base 
72; nodes 28. 30, 32, 42. 44, and 46 are equivalent 
respectively to nodes 78. 80. 92, 94. 96. 

Rgs. 4-6 show partial plan views of steps In a 
sequence of structures that are perceptible as con- 
tinuations of structure 10. and in which equivalent 
parts are labeled with the same reference numbers 
as in structure 10 in Rg. 1. These steps could 
occur in response to a request from a user to move 
node 32 to the primary viewing position shown. 
This request could be made by selecting tiie selec- 
table unit in node 32. 

In response to the user request, the path lead- 
ing from node 32 to root node 54 is presented 
differentiy from other nodes and links in structure 
10, so that the user can more readily distinguish it 
from other paths, as suggested in Rg. 4, Then, 
from the initial positions in Rg. 4, conic substruc- 
tures 12. 16. 18, and 20 are perceptible as rotating 
to tiie Intermediate positions in Rg. 5 and ulti- 
mately to the final positions in Rg. 6. As shown in 
Rgs. 4 and 5, tiie direction of rotation of conic 
substructures 16, 18, and 20 can be opposite tiiat 
of conic substructure 12. Also, the necessary rota- 
tions can be performed concurrently to move node 
32 to the primary viewing position more quickly. 

C. An Implementation 

The general features shown in Rgs. 1-6 could 
be implemented in many ways. Rg. 7 shows gen- 
eral steps performed by the current implementa- 
tion, which runs on a Silicon Graphics workstation. 
Rg. 8 shows an item in a data structure that is 
used to perform the steps in Rg. 7. 

The step in box 150 in Rg. 7 produces a linked 
node data stmcture that can include data defining a 
hierarchical structure as in Rgs. 1 and 2. Rg. 8 
shows node data item 180 from such a linked node 
data structure, and node data item 180 supports 



one of tiie nodes in a hierarchical structure. Item 
180 includes UID field 182 for the unique identifier 
(UiD) of tiie item, and parents' UID fiekJ 184 and 
children's UID field 196 include the UIDs of linked 

5 node data items. The step in box 150 produces a 
data structure in which these three fiekls define a 
tree. i.e. a rooted directed acyclic graph in which 
each node except tiie root has one and only one 
parent. The tree can be divided into hierarchical 

70 levels, with each node other than the root node 
being on a hierarchical level below the root node. 
Such a data structure could be produced by well 
known techniques from a wide variety of 
databases, including any directed graph, provided 

75 tiiat tiie non-tree links are not so numerous ttiat 
they interfere with presentation of the hierarchical 
structure. A similar data structure with more than 
one root node could be used to provide a multiply 
hierarchical structure. 

20 The otiier fields of item 180 include position 
field 188, for data indicating tiie three-dimensional 
coordinates of a node: data field 190. for data such 
as a word to be presented in the node's selectable 
unit; shrunken flag field 192. for data indicating 

25 whether the node includes a grow tab selectable 
unit tiiat can be selected to present a substructure 
in tiie next level below the node; color field 194. for 
data indicating tiie color of the node's selectable 
unit, which provides a tiiree-dimensional cue; base 

30 point field 196, for data indicating the node's posi- 
tion on tiie base of a conic structure by indicating 
one of the defined points on tiie base; selected 
path field 198. for data indicating whetiier the node 
is on a selected path between a node being moved 

35 to the primary viewing position and the root node; 
and child on patii field 200. for data indicating 
which of the node's children nodes is on ttie se- 
lected path, if any. Item 180 can include additional 
fields as appropriate. 

40 After a linked node data sb\jcture has been 
produced in box 150, subsequent steps in Rg. 7 
can operate on the data structure to complete or 
modify the hierarchical structure it defines. The 
step in box 152. for example, scans through the 

45 linked node data structure completing base point 
field 196 for each node based on the number of 
children nodes its parent has. As shown in Rg. 3, 
each conic substructure's base may have 80 de- 
fined points, so tiiat two children nodes may be 

50 assigned base points 0 and 40; three children 
nodes may be assigned base points 0. 26. and 53; 
four children nodes may be assigned base points 
0. 20. 40. and 60, and so forth. If tiiere are more 
children nodes than tiie number of base points. 

55 more than one child could be assigned to some of 
the base points or tiie number of base points could 
be increased. 

The step in box 154 also scans the linked node 
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data structure, completing position field 188 for 
each node and completing color field 194 based on 
each node*s position so that the color of its selec- 
table unit provides a three-dimensional cue. This 
step includes defining the sizes of conic substruc- 
ture bases on each level and the position of each 
base point in relation to the axis of its conic sub- 
structure, based on the number of levels of the 
hierarchicaJ structure to be presented. The step in 
box 156 then scans the linked node data structure 
and provides each node at Its position for display, 
together with data defining the links, the conic 
substructure bases, and shadows as discussed in 
greater detail below. 

After the structure is presented for display, the 
user may request a rotation operation, in t>ox 160. 
In response, the step in box 162 changes base 
point field 196 for each affected node to perform a 
step of the rotation before returning to the step in 
box 154. Depending on the nature of the requested 
rotation, the steps in boxes 162, 154, and 156 may 
be repeated several times to complete the re- 
quested rotation, as discussed below. 

1. Assigning Base Points 

Base point field 196 for each node can initially 
be completed in box 152 in Rg. 7 by steps as 
shown in Rg. 9. The step in box 250 t>egins at the 
root node's Item in the linked node data structure 
and the remaining steps perform a scan of the data 
structure, completing base point field 196 in each 
node's item. 

The step in box 252 prepares to assign base 
points to the children of the node currently being 
handled. To do so. this step counts the number of 
children's UIOs in field 186. tf more than one are 
counted, a set of points on the base of a conic 
substructure is selected according to the count, as 
in the examples given akx>ve. If there is only one 
UID in fiekj 186. a special value is selected to 
indicate that the single chikj node will be on the 
axis of the conk: substructure rather than at the 
perimeter of its base. 

The step in box 254 begins an iterative loop 
that handles each of the children nodes, accessing 
each child node using its UID from field 186. The 
step in box 256 assigns the next base point from 
the set selected in box 252 to the next child node, 
completing field 196 in its item in the data struc- 
ture. The step in box 258 then makes a recursive 
call for the child node being handled, so that base 
point field 196 is similarly completed for each of its 
children nodes. This recursive call enters the steps 
in Rg. 9 before box 252 and exits after the test in 
tx>x 254 indicates that there are no children or that 
all children have been handled, as shown by the 
circled letters A and B. 



If no children of the root node are counted in 
box 252, or when all children of the root node have 
been handled by the iterative loop, the step in box 
260 returns the data structure. Reld 196 is now 
5 completed in preparation for initial presentation of 
the hierarchical structure. 

2. Assigning Positions and Defining Levels 

10 Position field 188 and color fiekl 194 can be 
initially completed in box 154 in Rg. 7 and can be 
subsequentiy updated by the steps in Rg. 10. As 
in Rg. 9, the first step, in box 270. t)egins at the 
root node's item in the linked node data structure 

75 and the remaining steps perform a scan of the data 
structure, completing position field 188 and color 
field 194 in each node's item. The steps in Rg. 10 
also reduce tiie use of transcendental functions 
such as sines and cosines to calculate each node's 

20 position, as explained in greater detail below. 

The step in box 270 begins with data indicating 
the number of levels in the hierarchical structure to 
be presented for display. This data could be oth 
tained by one of the steps in boxes 150. 152, and 

25 162 in Rg. 7. If none of the nodes at a given level 
of the linked* node data structure has children, that 
is the lowest level of the structure to be presented, 
and the number of hierarchical levels can be deter- 
mined by counting the number of nodes in the path 

30 between one of the nodes at that level and the root 
node. 

The step in box 272 assigns a predefined 
position to the root node and completes the root 
node's color field 194. The root node is positioned 

35 on the central axis of the structure. If. for example, 
ttie axis extends in the y-dimension. tiie x- and z- 
coordinates of the root node define the position of 
the axis, and the y-coordinates of the bases of the 
levels can be determined by dividing the available 

40 length in the y-dimension by the number of levels 
obtained in box 270. The axis coordinates and the 
y-coordinates of the levels are provided for use in 
subsequent steps. 

The step in box 274 tests whetiier the shrunk- 

46 en flag field 192 of the node being handled in- 
dicates ttiat its children should not be presented. If 
not, the step in box 276 then branches to create a 
new offset array for the level of the children, if 
necessary. This branch is not taken if ttie node has 

so only one child or if an offset array for tiie child's 
level already exists and tiie number of levels has 
not increased. But if there is more than one child 
and there is no array or the number of levels has 
Increased, a new offset array is created in box 278. 

55 Each offset an-ay contains a respective offset 
for each base point value, and this offset can be 
combined through simple, rapid arithmetic oper- 
ations such as translations in tiie x-and z-dimen- 
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sions using the coordinates of the current axis and 
the level's y-coordinate to obtain a position on the 
base of the conic substructure. This avoids the 
need to perform transcendental functions except 
when a new anray is created in box 278. 5 

In creating a new offset array, the step In box 
278 first obtains the base size for the respective 
level. The base size for the uppermost hierarchical 
level, which can have no more than one conic 
substructure, can be a predetermined base radius w 
that depends on the parameters of the display. The 
base sizes for a lower level can be base radii, n. 
that are computed by dividing the uppermost level 
base radius by 2* + ^ where i Is the number of 
levels to the lower level. This provides satisfactory 75 
base sizes if is less than ten; for levels tower than 
the tenth, the base sizes it provides will be too 
small. 

Using the base size, the step in box 278 pro- 
duces an array of coordinate offsets from the can- 20 
ter of the base to each of a predetermined number 
of equally spaced points on the base. This step 
employs the transcendental functions. Fig. 3 illus- 
trates the case where coordinate offsets for 80 
points are found, and most conventional graphics 25 
libraries use 80 points to draw a circle. But fewer 
than 80 points would suffice for a smaller base, as 
long as the number of points is sufficient for the 
perception of rotation of the conic substructure to 
be obtained with the resulting point spacing. For a 30 
structure that Is presented with axes extending in 
the y-dlmension, each array can thus be an array 
of ordered pairs {(Xo.Zoj.-.pOs.Zyg)} in which each 
offset can be a floating point number. The arrays 
can be combined or otherwise manipulated for 35 
compact storage and speedy retrieval. The follow- 
ing fonmulae can be used to obtain the anrays: Xo = 
0.0; Zq = - 0; X| = X| - icos 0 + Z( - isin 0; and 
Zi = Zi - 1C0S 0 - X| - isin 0, where 0 = 2n/80. 

The step in box 280 then begins an iterative 40 
loop that handles each of the children of the node 
being handled. For the child being handled, the 
step In box 282 accesses its base point field 196 to 
obtain its base point, then accesses the appropriate 
offset array to obtain its offsets, or obtains zero 45 
offsets If there Is only one child, to complete posi- 
tion field 188 and color field 194. The color field 
can be completed with a value that provides a 
shading gradient from the front to the rear of the 
perceived three-dimensional space when viewed so 
from a predetermined primary viewing position. If 
the primary viewing position Is along the z-dlmen- 
sion. for example, the shading of a node could be 
directly dependent on the node's z-coordinate. 

The step in box 284 makes a recursive call for S5 
the child node being handled, so that position field 
188 and color field 194 are similarly completed for 
each of its children nodes. This recursive call en- 



ters the steps in Rg, 10 before box 274 and exits 
after the test in box 274 indicates that the children 
are not presented or the test in box 280 indicates 
that there are no children or that all children have 
been handled, as shown by the circled letters C 
and D. 

If the root node is shrunken, or when all of its 
children have been handled as described atx>ve. 
the step in box 290 returns the completed linked 
node data structure. It is now ready for display. 

3. Displaying the Structure 

The Silicon Graphics workstation on which the 
invention was implemented provides facilities for 
presenting Images that are perceptible as three- 
dimensional, and also for allowing the user to per- 
form conventional animated operations such as af- 
fine transformations (rotation, translation, and scale) 
in the perceived three-dimensional space without 
repositioning of features. These and other facilities 
are described in SGI Graphics Ubrary Program- 
ming Guide . SilicorTGraphics Inc., Mountain View, 
CaliTornia. For example, the Silicon Graphics work- 
station Includes facilities for Z-buffering or hidden 
surface elimination, making it relatively simple to 
display a hierarchical structure with perspective 
and other cues so that it is perceptible as three- 
dimensional. If such facilities were not available, a 
similar effect could be obtained by sorting tiie 
items to be displayed according to their distance 
from the viewing position and using a painter's 
algorithm to paint them from back to front. Another 
example is tiie alpha blending facilities used for 
transparency effects, which can be used on shad- 
ows and on the bodies of conic substructures. 

Rg. 1 1 shows steps in displaying a hierarchical 
structure. The step in box 300 starts at the root 
node of a linked node data structure, and also has 
data indicating tiie position of a shadow plane, 
which may be a coordinate indicating a plane that 
is perceptible as receding from an appropriate 
edge of the display. 

The step in box 302 provides the position, 
color, and data of the root node for presentation of 
its selectable unit. As illustrated in Rgs. 1 and 2. 
the selectable units of the nodes can all be of 
equal size, in which case it is not necessary to 
provide data indicating size and shape of each 
selectable unit. If the conic substructures are verti- 
cally oriented as in Rg. 1. the position provided 
can. for example, be the center of the upper edge 
of a rectangular selectable unit; if horizontally ori- 
ented as in Rg. 2. the position can bQ the center of 
the left edge. 

The steps in boxes 304 and 306 begin an 
iterative loop that scans through the data structure, 
providing data for each node to the three-dimen- 



15 



EP 0 435 601 A2 



16 



sional image presenting facilities of the workstation. 

The step In box 304 detenmlnes whether the 
node currently being handled is shrunken, in which 
case the step in box 308 provides position and 
color for a grow tab selectable unit for adding 
additional links and nodes, as illustrated in Rgs. 1 
and 2. The step in box 310 then provides data 
defining the shadow of the selectable unit, as dis- 
cussed in greater detail below. 

If the node is not shrunken, and If the step in 
box 306 determines that it has children that have 
not been handled, the step in box 312 provides 
position, color, and data for presentation of the next 
child's selectable unit and of the link to its parent. 
The link can be presented in the same color as the 
selectable unit or in a related color. Then, the step 
in box 314 makes a recursive call for the child 
node being handled, to provide position, color, and 
data for presentation of each of its children nodes. 
This recursive call enters the steps in Rg. 11 
before box 304 and exits after box 310 or box 316, 
as shown by tiie circled letters E and F. 

When all tfie children of a node have been 
handled in this manner, the step in box 316 pro- 
vides additional features of the conic substructure 
depending from tfie node, including features in- 
dicating the shape and coloration of a cone, of tiie 
cone's base, and of the cone's shadow on the 
shadow plane. Rather ttian providing tiie body of 
the cone with 80 nanrow triangles to obtain a cir- 
cular cone, it is simpler to provide a polygonal 
base and cone with as many sides as there are 
nodes. The shadows and other colors can be com- 
bined through alpha blending, performed automati- 
cally by tiie Silicon Graphics workstation. 

As noted above, tiie steps in boxes 310 and 
316 provide shadows for display. Shadows can be 
used to provide depth cues that assist the user in 
perceiving an image as three-dimensional, and also 
to provide information about the hierarchical struc- 
ture with which they are displayed. Conventional 
techniques for providing shadows redraw tiie shad- 
owed structure with one dimension collapsed, as 
described in Thessman. T.. "Casting Shadows on 
Rat Surfaces,* IRIS Universe . Winter 1989, pp. 16 
and 18-19, As described t>elow, the steps in t>oxes 
310 and 316 can provide shadows more simply. 

Rg. 12 shows outiines of shadows presented 
on a shadow plane that is perpendicular to tfie axes 
of the conic substructures, which has been imple- 
mented for stnjctures whose conic substructures 
are vertically oriented. Rg. 13 shows outlines of 
shadows presented on a shadow plane that is 
parallel to the axes of tiie conic substructures, 
which has been implemented for structures whose 
conic substructures are horizontally oriented. In 
each case, the shadows shown correspond to the 
conic substructures in the upper levels of the hier- 



archical structures in Rgs. 1 and 2. 

Shadow pattern 330 in Rg. 12 includes rectan- 
gular outiine 332 for conic substxjcture 12 witii four 
children nodes, triangular outiine 334 for conic sub- 

5 structure 14 witti ttiree children nodes, and line 336 
for conic substructure 16 with two children nodes. 
The shapes of the shadow outiines ttius indicate 
tiie number of children nodes for each conic sub- 
structure, and tiie sizes of each shadow indicates 

70 the hierarchical level of ttie respective conic sub- 
structure. The shapes and sizes of the shadows are 
tiie same as for tiie bases of tiie conic substruc- 
tures, but with the shadow plane coordinate. 

Shadow pattern 340 in Rg. 13 includes triangu- 

75 lar outlines 342, 344. and 346 for conic substruc- 
tures 62,64, and 66. respectively. Shadow pattern 
340 also includes a respective line for each node's 
selectable unit, including line 352 for node 78 and 
line 350 for node 96. The positions of tiie outiines 

20 indicate the hierarchical levels of the respective 
conic substructures, and tiie numbers of lines in- 
dicate the numbers of nodes in each substructure. 
The shapes of ttie triangular outlines can be ob- 
tained by recording the minimum and maximum 2- 

25 coordinates of the children nodes, so that each 
triangular outiine is drawn in the shadow plane with 
vertices at the position of ttie bottom of tiie parent 
node's selectable unit and at the positions of the 
children nodes with the minimum and maximum z- 

30 coordinates. The selectable units can be drawn by 
protecting lines parallel to the axis from the position 
of each child node. 

As can be seen from Rgs. 12 and 13. the 
shadows provide a view of the structure that pro- 
ds vides some information about its hierarchy and 
about the clustering of nodes witiiin tiie hierarchy. 
The shadow plane can also convenientiy include 
selectable units such as buttons for navigation or 
otiier purposes. 

40 

4. Rotation Operations 

The cunrent implementation provides two broad 
types of rotation operations. In a first type of rota- 

45 tion, the conic substructures in all or part of the 
hierarchical structure each rotate by one base point 
in a clockwise direction for each animation step. In 
a second type of rotation, an indicated node is 
moved to a primary viewing position by a combina- 

50 tion of rotations of conic rotations. Rg. 14 shows 
steps in an animation step during rotation of tiie 
first type. Rg. 15 shows steps in finding a selected 
path from an indicated node to ttie root node when 
the user requests the second type of rotation. Rg. 

55 1 6 shows steps in an animation step during rotation 
of the second type. 

Botii types of rotation as well, as other oper- 
ations such as translation, rotation, aruj scale, can 
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be performed by animated steps, implemented as 
described in Robertson. G.Q.. Card, S.K.. and Mac- 
kinlay, J.D.. "The Cognitive Coprocessor Architec- 
ture for Interactive User Interfaces," Proceedings of 
the ACM SIGGRAPH Symposium on User Interface 
SofN?ire and Technology , Williamsburg, Virginia, 
Novemberl3-15, 1989, pp. 10-18. In addition to 
the steps described below, each animation loop 
includes a number of other steps, and ends with a 
call to display the hierarchical structure as modified 
by the animation loop. 

Rg. 14 illustrates steps in an animation loop 
that rotates each node in all or part of the hierarchi- 
cal structure by one base point. The step in box 
360 starts with the upper node of the part of the 
hierarchical structure being rotated, which is the 
root node if the entire structure is rotated. The step 
in box 362 begins an iterative loop that handles ail 
the children of the current node. The step in box 
364 increments the next child's base point field 
196, or, if the base point field indicates that the 
node has no siblings, leaves it unchanged. The 
step in box 366 makes a recursive call for the next 
child node, which enters the steps in Rg. 14 before 
box 362 and exits after box 367, as shown by the 
circled letters G and H, When ail the nodes have 
been incremented, the step in box 367 determines 
whether the upper node has t>een reached. If not. 
the routine returns at W. but if so. the step in box 
368 requests repositioning for display, which is 
performed with the teps in Rg. 10. 

Rgs. 15 and 16 illustrate the second type of 
rotation, which can be requested by indiating a 
displayed node to be moved to the primary viewing 
position. When a user indicates a position on the 
display of the workstation with a pointing device 
such as a mouse, the workstation's picking facilities 
provide a list of selectable units at the indicated 
position, which is received in the step in box 370 in 
Rg. 15. The test in box 372 determines whether 
the list is empty, and if It is, the step in box 374 
exits to wait for the next user request 

If the list includes one or more selectable units, 
and if the nearest one is a node's selectable unit 
rather than one of the other selectable units, the 
system responds by moving the node's selectable 
unit to the primary viewing position, and the re- 
maining steps in Rg. 15 prepare the linked node 
data structure for this operation. 

The step in box 376 clears the previous se- 
lected path and child on path data from fields 198 
and 200 In each item in the data structure. The 
step in box 378 then uses the UID of the nearest 
node on the list to find its item in the data struc- 
ture, whose selected path field is then set to in- 
dicate that it is on the selected ath. 

The step in box 382 begins an iterative loop 
that continues until the root node is reached, ac- 



cessing the items in the linked node data structure 
for each node in the selected path. The step in box 
382 tests whether tiie cunrent node has a parent by 
accessing its parent's UID field 184. If so, the step 

5 in box 384 accesses the parent node's item, sets 
its child on path field 200 to indicate ttie child on 
the selected path, and sets its selected patii field 
198 to indicate that it is on the selected path. 
When tiie root node is reached, the step in box 386 

10 returns the linked node data structure for subse- 
quent operations. 

Rg. 16 shows steps in an animation loop tiiat 
rotates conic substructures to move a node to the 
primary viewing position. The step in box 400 

75 starts with tiie root node and with a Done variable 
set to Indicate that the rotation is completed. The 
test in box 402 determines whether the node cur- 
rentiy being handled has a child on the selected 
path. If so. the child's item in tiie linked node data 

20 structure is accessed in box 404 and the te§t in 
box 408 determines whether its base point has 
reached 40, the primary viewing position. If so, the 
animation ioop proceeds to tiie test in box 402 for 
the child node, to see if it has a child on the patii. 

25 If a node has not yet reached tiie primary 
viewing position, the step in box 410 moves its 
base point by one step toward 40 (by eitiier addi- 
tion or subtraction) and clears the Done variable; 
one step may be \hree base points, or, if the node 

30 is already within tiiree of 40, the number necessary 
to move it to 40. In this way, each node is moved 
in whichever direction will bring it most quickly to 
the primary viewing position, and two conic sub- 
structures may rotate in opposite directions. 

35 When the lowest node in the path is reached, 
tiie step in box 412 determines whether tiie rotation 
is completed by testing tiie Done variable. If it has 
not been cleared, the rotation request is cleared in 
box 414 before calling the steps in Rg. 10 to 

40 reposition tiie nodes for display. 

The rotation request could also be cleared 
whenever the user requests any other operation, to 
ensure that the user always has interactive control 
over the display. When no request is received from 

45 tiie user and no animation is in progress, the 
system can go into an idle mode in which the 
animation ioop is not performed until the user 
makes another request. 

In general, to allow interactive control at all 

50 times, tiie animation loop should be set up so tiiat 
any long process is broken up into small steps, 
between which tiie process can be intenrupted. 

The rate at which Uie animation loops are per- 
formed should be sufficiently slow to allow the 

55 necessary computation but suffidentiy fast so that 
conic substructures rotate perceptibly. The neces- 
sary computation depends, of course, on the com- 
plexity of the hierarchical structure. If tiie computa- 
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tion Is so great that it would slow the repositioning 
and display operations, governor techniques can 
be used to reduce the amount of repositioning, 
thereby sacrrfidng detail in the image for steady 
animation. Governor techniques could aiso be used 
to increase the size of steps in rotation, to ensure 
that the motion being presented can be performed 
In a given amount of time, as measured by the 
wortcstation's clock. 

5. Other Operations 

Various other operations could t>e available to 
the user for manipulating the hierarchical structure. 
These operations could be invoked by appropriate 
signals from a user input device, such as signals 
indicating selection of a selectable unit such as a 
menu Item, signals indicating a gesture requesting 
an operation, or signals indicating a typed com- 
mand requesting an operation. If a mouse with 
multiple buttons is used, one button can be used to 
request display of a menu and to select a menu 
item, another to select a node to be moved to the 
primary viewing position or to gesture and perform 
other selection operations. 

Two operations that assist a user in controlling 
the display of the hierarchical structure are 'grow' 
and 'shrink' operations. These operations assist the 
user in viewing the relevant part of the hierarchical 
structure. Rg. 17 shows steps in an example of a 
'shrink' operation, and Rg. 18 shows steps in an 
example of a 'grow' operation. 

The step in box 430 in Fig. 17 receives a 
request to perform a 'shrink' operation togetiier 
with a list of selectable units at a position indicated 
by the user from the workstation's picking facilities. 
The step in box 432 tests whether the list has at 
least one selectable unit and whether the nearest 
selectable unit on the list is a node. If not, a 'shrink' 
operation cannot be performed, so the step in box 
434 exits, providing a failure signal if appropriate. 

When a 'shrink" operation can be perfomned, 
the step in box 438 uses the UIO of the node being 
handled to access the node's item in the linked 
node data structure and sets the node's shainken 
flag 192. Upon finding the node's shmnken flag 
192 set the steps in Rg. 11. during the next 
redisplay of the hierarchical structure, display a 
grow tab selectable unit and do not present the 
node's children. 

The step in box 438 begins an iterative loop 
that handles each of the children of the current 
node, making a recursive call in box 442 that 
enters and exits as shown at J and K. When the 
step in box 440 detenmines that all of the children 
of the node have been handled, the step in box 
444 returns the data structure. 

The step in box 450 in Rg. 18 receives a list of 



selectable units at a position indicated by the user 
from the workstation's picking facilities. The step in 
box 452 branches based on whether the list has at 
least one selectable unit and whether the nearest 

5 selectable unit on the list is a grow tab. indicating a 
request for a grow operation. If not. anotiier request 
made by the user is handled in box 454. 

When a grow operation is requested, the step 
in box 456 obtains the UID of ttie grow tab's node 

10 and uses it to access the node's item in the linked 
node data structure. This step also clears the 
node's shrunken flag 192. Upon finding the node's 
shrunken flag 192 cleared, the steps in Rg. 11. 
during the next redisplay of the hierarchical struc- 

15 ture. present the node's children and their links. 
Because the children's shrunken flags have been 
set by the steps in Rg. 17, however, their chikJren 
are not presented. 

A user could request a 'grow' or 'shrink* opera- 

20 tion in other ways, such as by a gesture or sela:- 
tion of a menu item. A variety of related operations 
can be implemented, including an operation tiiat 
shrinks the entire structure to the root node, an 
operation that grows all of tiie grow tabs in the 

25 structure, an operation that shrinks all of the sib- 
tings of a selected node but not the selected node, 
and an operation that grows all of the levels of 
nodes tiiat depend from a grow tab rather than just 
tiie first level as in Rg. 18. 

30 

6. System Features 

Rg. 19 shows components of system 500 im- 
plementing the features described above. System 

35 500 includes processor 502. which could be any 
processor and could include one or more CPUs 
and may include specialized hardware such as one 
or more coprocessors to provide specific functions. 
Processor 502 is connected for receiving signals 

40 based on user input actions from a user Input 
device that includes keyboard and mouse 504. and 
is also connected for providing image data to an 
image output device that includes display 506. 
Processor 502 is aiso connected for accessing 

45 program memory 510 and data memory 540. 

Program memory 510 includes instructions ex- 
ecuted by processor 502 during its operation, in- 
cluding the following: Underiying system software 
and firmware 512 provide the operating system and 

50 other facilities of system 500. Main hierarchical 
structure routine 514 is called and performed when 
the user requests presentation of a hierarchical 
structure, and can include steps like those in Rg. 

7. Base point subroutine 518, called by main rou- 
55 tine 514. assigns base points to nodes in the 

hierarchical structure, and can Include steps like 
those in Rg. 9. Positioning subroutine 518, called 
by main routine 514, assigns positions to nodes. 
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and can include steps like those in Rg. 10. Display 
subroutine 520, called by main routine 514. pro- 
vides nodes for display, and can Include steps like 
those In Ftg. 11. Selected path subroutine 522. 
called when the user requests movement of a node 
to the primary viewing position, finds the path from 
the node indicated to the root node, and can in- 
clude the steps In Fig. 15. Grow/shrink subroutines, 
called when the user requests a growing or shrink- 
ing operation, can include the steps of Figs. 17 and 
18. Animation loop routine 526, periodically ex- 
ecuted, calls first rotation subroutine 528, which 
can include the steps of Rg. 14, and second rota- 
tion subroutine 530, which can include the steps of 
Rg. 16. 

Data memory 540 includes data structure ac- 
cessed by processor 502 during execution of 
instructions in program memory 510, including the 
following: Database 542 Is an underiying data 
structure accessed by main routine 514. Linked 
node data structure 544 is produced by main rou- 
tine 514 based on database 542 and is used by 
most of the other routines shown. Database 542 
can thus have any form that admits of the produc- 
tion of a linked node data structure relating to its 
contents. Offset arrays 546 are produced and used 
by positioning subroutine 518. Node-UID tables 
548 are set up by system software 512 to map 
between selectable units and tiie UIDs of their 
respective nodes. Miscellaneous data 550 include 
initial values and other data that are used in ex- 
ecuting instructions in program memory 510. 

D. Miscellaneous 

The invention could be implemented in many 
ways on a variety of machines. Some features 
might be implemented differently from those de- 
scribed above, to take advantage of specialized 
hardware or software available on a specific ma- 
chine. 

The invention has been described in terms of 
conic substructures that are perceptible as rotating. 
The invention could also be implemented with con- 
ic substructures that are not perceptible as rotating 
but that define paths along which nodes and links 
are perceptible as moving. For example, to im- 
prove tiie use of screen display space, a fixed 
elliptical or other oblong shape might be chosen for 
the conic substructures. This might reduce the 
extent to which nodes that are perceptible as near 
obscure nodes that are perceptible as distant In 
moving to the primary viewing position, a node 
would follow the base of the conic substructure, but 
the conic substructure itself would not rotate. As 
described atx^ve, base points on the base of the 
conic substructure could be precomputed and used 
in moving a node to the primary viewing position. 



Claims 

1. A metiiod of operating a processor connected 
for providing image data to an image output 
5 device that includes a display, the image out- 

put device presenting images on the display in 
response to the image data, the method com- 
prising: 

providing first image data so that the image 

70 output device presents a first image, the first 
image including a first hierarchical structure 
that is perceptible as tiiree-dimensional. the 
first structure including a first plurality of nodes 
and a first plurality of links, each of the first 

75 plurality of links being perceptible as connect- 
ing one of the first plurality of nodes to another 
of tiie first plurality of nodes; and 
providing second image data so that the image 
output device presents a second image, the 

20 second image including a second hierarchical 
structure that is perceptible as three-dimen- 
sional and that is perceptibly different from the 
first structure; the second structure including a 
second plurality of nodes and a second plural- 

25 ity of links, each of the second plurality of links 

being perceptible as connecting one of the 
second plurality of nodes to another of the 
second plurality of nodes; each of the second 
plurality of nodes being perceptible as a con- 

30 tinuation of a respective one of the first plural- 
ity of nodes, each of the second plurality of 
links being perceptible as a continuation of a 
respective one of the first plurality of links. 

35 2. The mettnod of claim 1, in which each link of 
the first and second pluralities of links is per- 
ceptible as having a length, the perceptible 
length of each of the second plurality of links 
being the same as the perceptible length of 

40 the respective one of the first plurality of links. 

3. The method of claim 1 or 2, in which the first 
and second structures have equal numbers of 
hierarchical levels. 

45 

4. The method of claim 3, in which each hierar- 
chical level includes at least one conic sub- 
structure, second and fourth ones of tiie conic 
substructures of ttie second structure being 

50 perceptible respectively as rotated continu- 
ations of first and third ones of the conic 
substructures of the first structure. 

5. The metiiod of claim 4, in which the percep- 
55 tible rotation from the first conic substructure 

to tiie second conic substructure is atxDut a 
first axis, and the perceptible rotation from the 
tiiird conic substructure to the fourth conic 
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substructure is about a second axis, the first 
and second axes of perceptible rotation being 
parallel to each other. 

6. The method of claim 5. in which the first and 
second axes are vertical. 

7. The method of claim 5, in which the first and 
second axes are horizontal. 
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8. The method of any preceding claim, in which 
the first structure includes a conic substructure 
having a vertex and a base, the first plurality of 
nodes including a parent node at the vertex 

and a plurality of children nodes at the base. ts 
the first plurality of links including, for each of 
the children nodes, a respective link in the 
conic substructure, the respective link being 
perceptible as connecting the parent node to 
the children node. 20 

9. The method of claim 8. in which the conic 
substructure is perceptible as having an axis 
and a profile shape in a first plane that in- 
cludes the axis, the first image further includ- 25 
ing a first projected shape that is perceptible 

as a projection of the profile shape of the conic 
substructure onto a second plane. 

10. The method of claim 9. in which first and 30 
second ones of the respective links have posi- 
tions that define the profile shape in the first 
plane and the second plane is perceptible as 
parallel to the first plane, the step of providing 

the first image data further comprising the sub- 35 
step of determining the positions of the first 
and second respective links and using the po- 
sttiof^ both to prepare first structure data de- 
fining the first structure and projection data 
defining the first projected shape. 40 



45 
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0 Display of hierarchical three-dimensional structures. 



0 A processor presents a sequence of images of a 
hierarchical structure that is perceived as three-di- 
mensional. The hierarchical structure includes conic 
substructures (12. 14. 16. 18, 20) that can have 
vertical or horizontal axes. Each cone (12, 14. 16. 18. 
20) has a parent node at its vertex and children 
' nodes along its base, each with a link to the parent 
node. Each child can in turn be at the vertex of 
^ another cone. The cones (12. 14. 16. 18. 20) can be 
^ rotated in steps that produce the perception of ob- 
ject constancy for each node. For example, if the 
Q user requests that an indicated node be moved to a 
<0 primary viewing position, each of the cones along 
1^ the path from the indicated node to the root node is 
(V) rotated in the direction that most directly moves the 
^ indicated node to the primary viewing position. Each 
Q node can include a selectable unit for indicating it. 

and a node can also include a grow tab that can be 
^ selected to request presentation of its children nodes 



and links to them. The user can request that the 
children nodes of a node be replaced by a grow tab. 
To reduce the computation necessary for each step 
of rotation, the position relative to a cone's axis for 
each of 80 points on the base of a cone (12, 14. 16. 
18. 20) is computed for a level of the hierarchy and 
is tiien stored in an array for subsequent use in 
positioning nodes on that level. The base point (52) 
of each node on a rotating cone can then be 
changed in a linked node data structure, and its new 
position can then be obtained by simple arithmetic 
operations using the axis coordinates and the appro- 
priate data from the array. The base of each array 
can be a polygon whose vertices are nodes, and the 
base shape can be presented as a shadow to pro- 
vide additional information and strengthen the per- 
ception of three dimensions, or. the profiles of the 
cones can be presented as a shadow. 
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